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In this paper we will give a short presentation of the quantum Levy-Khinchin 
formula and of the formulation of quantum continual measurements based on 
stochastic differential equations, matters which we had the pleasure to work on 
in collaboration with Prof. Holevo. Then we will begin the study of various en- 
tropics and relative entropies, which seem to be promising quantities for measuring 
the information content of the continual measurement under consideration and for 
analysing its asymptotic behaviour. 



1 A quantum Levy-Khinchin formula 

The theory of measurements continuous in time in quantum mechanics 
(quantum continual measurements) started with the description of counting 
experiment^ and of situations in which an observable is measured imprecisely, 
but with continuity in time™ both formulations are based on the notions of 
instrument^ and of positive operator valued measure. Soon after we suc- 
ceeded in unifying the two approaches j^HolevcS realized that some quantum 
analogue of infinite divisibility was invo lved and thus started a searc h of a 
quantum Levy-Khinchin formulapEEEl a rev j ew j s gj ven j n re f s . EMS] wn ii e 
a different approach is presented in refs.Hl 

Let H be a complex separable Hilbert space, T(7i) be the trace-class on 
H and S(H) be the set of statistical operators. We denote by C(H 1 ;Ti.2) the 
space of linear bounded operators from Hi into H2 and set £(Tt) = £(Tt; TL). 
(o,t) = Tr{ar}, r G T(H), a G C(H); IM^ = Tr {Vr^}. 

An instrument is a map- valued cr-additive measure Af on some measurable 
space (y,B); the maps are from T(TL) into itself, linear, completely positive 
and normalized in the sense that Tr{N'(y) [r] } = Tr{r}. 

The formulation of continual measurements given by HolevcP^ is based on 
analogies with the Levy processes and it is less general, but more fruitful, 
than the one initiated by our groups and based on the generalized stochastic 
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processes. In order to simplify the presentation, we will only consider the case 
of one-dimensional processes. Let y be the space of all real functions on the 
positive time axis starting from zero, continuous from the right and with left 
limits, and let B\, < a < b, be the cr-algebra generated by the increments 
y(t) — y(s), a < s < t < b. A time homogeneous instrumental process with 
independent increments (i-process) is a family {Af b ;0 < a < b}, where Af b is 
an instrument on (y,B b a ) such that Af b ^t ( E t) = N b (E) for arbitrary b > a, 
t£R + ,E G B b , where E t = {y : T t y G E}, (T t y)(s) = y(s + t), and such that 

Af*(E)oMZ(F)=AfZ(EnF), 0<a<b<c, E G B b a , F e B%. (1) 

Every i-process is determined by its finite-dimensional distributions, which 
have the structure 

Nl*(y{-) : y(h) - y(t ) efli,.. .,y(t p ) - y(t p ^) e B p ) 

= M tp - tp _ 1 (B P )o---oM tl - t0 (B 1 ), (2) 

where < t < ti < ■ ■ ■ < t p , B : , . . . , B p G B(E), and 

Af t (B) = N a a +t (y(.) : y(a + t)- y(a) G B) (3) 

is independent of a by the time homogeneity. The instrument Af t completely 
determines the i-process and it is completely characterized by its Fourier 
transform (characteristic function) J R e lkv M t (dy)) Eq. and the continuity 
assumption 

lim \\Af t (Uo) — HI 1 1 = , for every neighbourhood Uq of 0, (4) 

imply that this characteristic function is of the form exp{i/C(fc)}, JC(k) G 
£(T(7Y)). The quantum Levy-Khinchin formula is the complete character- 
ization of the generator K$ The structure of K, can be written in different 
equivalent ways and here we give an expression^! which is particularly con- 
venient for reformulating the theory of the continual measurements in terms 
of stochastic differential equations, as illustrated in the next section. 

The quantum Levy-Khinchin formula for the generator K, is: Vr G T(TL), 
Vk G R, Vh,g G H, 

/C(fc)[r] = C[t] + ikcr - - r 2 k 2 T + ikr (Rt + tR*) 

+ [ [(e ikz - 1) J[t](z) - \kz V2 {z)r] A»(dz) , (5) 
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where eel, r€l, ip 2 (z) = 7^ ^, b > 0, 

o z + z^ 

£ = C + A + £ 2 , (6) 
£ [r] = -i[H, t] + i f] ([^r, L*] + [L rfl rZ*]) , (7) 

AM = i([i?r,i?*] + [i?,Tii*]), (8) 
£ 2 [r] = -ijVr-irJV + Tr i? {JrJ*}, (9) 

J [|ft)( 5 |] (z) = f; { " }) |(J/i)(z, n) + ft) (( J ff )(z, n)+g\, (10) 

n=l 

R,H,Lj G £(W), = if*, J2T=i L j L i £ ( stron S convergence), R* = 

R\{0}, ^ is a cr-finite measure on R, x N and /i(dz) = J^^Li ^(d- 2 x {"-}); we 
assume that 

/ <pi(z)fi(dz) = ^ / 931(2) ^(dz x {n}) < +00 , (11) 

• / ". n=l • /R . 

with <y5i(z) = — Note that V>i(z) + <£i{z) = 1 and that fi is a Levy 

cr + z 2 

measure on R*. Finally, J G C(H;Ll(H)), where L 2 = L 2 (R„ x N,z/), 
= L 2 (R» x N,i/;W) ~ Ll®U. The fact that the operators ff, R, 
Lj, J are bounded is due to the assumption (@J, which is therefore a strong 
restriction from a physical point of view. 

It is convenient to introduce also the characteristic functional of the whole 
i-process as the solution of the equation: Va G C(7i), Vr G T(H), 

(a, Gt(k)[T}) = (a,r) + f (a, JC(k{s)) ° Q s {k)[r\) ds , (12) 



where is a real function, continuous from the left with right limits; let 
us call it a test function. By taking k(t) = ftlmr)^), we get Gr{k) = 
exp{T/C(K)} and, similarly, by taking a more general step function for k we 
get the Fourier transform of the finite-dimensional distributions J2J) , so that 
Qt completely characterizes the i-process. 

The operators U(t) = exp{i£} = Qt(0) — M(R), t > 0, form a completely 
positive quantum dynamical semigroup. We fix an initial state g G S(Ti) and 
set rj t —U (t) [g] ; rj t is called the a priori state at time t because it represents 
the state of the system at time t, when no selection is done on the basis of the 
results of the continual measurement. The a priori states satisfy the master 
equation 

^-r]t=C[T]t], Vo = Q- (13) 
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2 Stochastic differential equations 

An alternative useful formulation of quantum continual measurements is based 
on stochastic differential equations (SDE's); it was initiated for the basic 
cases by BelavkiifESby using analogies with the classical filtering theory. The 
general SD E's corresponding to the Levy-Khinchin formula (SJ) were studied 
in refs. El. 



2.1 Output signal and reference probability 

Let W be a one-dimensional standard continuous Wiener process and N(dz x 
dt) be a random Poisson measure on R* x R + of intensity /i(dz)di, independent 
of W. The two processes are realized in a complete standard probability 
space (rt,!F,Q) with the filtration of er-algebras \Tt, t > 0}, which is the 
augmentation of the natural filtration of W and N; we assume also T = 
Vt>o^ r * - ^ ^ s usem l to introduce the compensated process 

N(dz x dt) = N(dz x dt) - fi(dz)dt . (14) 

In all the SDE's such as Eqs. (15)1. (fTTfl . (JTSJ, (15). (51)l. the presence of 
integrals with respect either to the jump process N or to the compensated 
processes N or N (see (28[ll is due to problems of convergence of the stochastic 
integrals which arise when infinitely many small jumps are present (the case 
J R fi(dz) — +oo). 

Now, by using W , N and all the ingredients entering the Levy-Khinchin 
formula (5J) , we are able to construct various random quantities which allow us 
to reexpress in a different form the i-process of the previous section. Firstly, 
let us introduce the real process 

Y(i) = ct + rW(t)+ tpi(z)zN(dzxds)+ ip 2 (z)zN(dz x ds) , 

JR.x(0,t] JM,x(0.t] 

(15) 

which, under the reference probability Q, is a generic Levy process; Y will 
represent the output process of the continual measurement introduced in the 
previous section. In the following we shall need the quantity 

$t(fc) =exp|ij^ fe(s)dy(s)| (16) 
and its stochastic differential 
d* t (fc)=#t(fc)j J (e Mt)z -l-ik(t) i p 2 (z)z^ t i(dz)+ick(t) 

- i r 2 k(t) 2 dt + irk(t)dW(t) + [ (e ik{t)z - l) N(dz xdt)\. (17) 
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In Table 1 we summarize the rules of stochastic calculus for W and N, which 
have been used in computing d$t{k) and which shall be used to compute all 
the stochastic differentials in the rest of the paper. 



Table 1. The Ito table and an example of application with only the jump part. 





dt 


dW{t) 


N{dz x dt) 


dt 











dW(t) 





dt 





N(dz' x dt) 








5(z - z') N(dz x dt) 



f(x + J Rr C(z)N(dz x dt)) -f(X) = J Rt [f(X + C(z)) - f(X)} iV(dzxdt) 



2.2 A linear SDE and the instruments 

Let us consider now the linear SDE for a t <E T(Tt), a t > 0: Va 6 £(?i), 

(a, a t ) = (a, g) + / (a, £[a s ]) ds + [ (a, Ra s + a s R*) dW(s) 
Jo Jo 

(a,J[a s ](z) - a s )N(dz x ds). (18) 

«x(o,t] 

We call the at non normalized a posteriori states (nnap states); the reason 
will be clarified in the following. The coefficient of the jump term should 
be written as J~[a s ~](z) — a s ~, with the following meaning: when there is a 
jump of N, i.e. when N(dz x ds) = 1, the nnap state before the jump a s - is 
transformed into the state after the jump a s + = J[a s -]{z); however, we prefer 
to simplify the notation and not to write the superscripts "minus" . Similar 
considerations apply to all the other SDE's. 

By using Table 1 to differentiate <&t(fc)(a, at), we get 



d($ t (fc)(a, a t )) = * t (A) j (a, /C(fc(t)) [a t ]) dt + (a, irk(t)a t + Ra t 

+ a t R*)dW(t) + j (a,e ik{t)z J[a t ]{z)~a t ^N{dzxdt)\ (19) 



and by taking the expectation we see that the terms with dW and N disappear 
and that the resulting equation is the same as Eq. I|12|) . which defines Q. 
Therefore, we have 

(a,g t (k)[g})=E Q ^ t (k)(a,at)}, (20) 

an equation showing that Y(t) and at completely determine the characteristic 
functional of the continual measurement and, so, the whole i-process. In 



particular, by taking k — we obtain that the expectation value of the nnap 
states gives the a priori states: Eq [(a, at)] — (a, 774). 



2.3 The physical probability and the a posteriori states 

Let us now study the norm of the nnap states: || ]| = (J, <7 f ) = Tr{<7t}. By 
taking the trace of Eq. (jT%|l we get 

dlHIi = \\a t \\Jrn(t)dW(t)+ [l t (z) - l]N(dz x dt)\, (21) 

where 

m(t) = (R + R*, Pt ), X t (z) = (l,J[p t ](z)) = {3(z),p t ), (22) 



(g\Z(z)h) = f; "( dz * ^ ((Jg)(z,n)+g\(Jh)(z,n) + h), Vg,heH, 

(23) 

UWtW^at if ll^lli > 
Pt - < . ^4) 

I p otherwise 

The operators belong to S(Tl) and will be called a posteriori states, as 
explained below. Note the common initial state: r/Q = °"o = Pa = Q- It is 
possible to show that Hotfo;)^ is a martingale and that it can be used as a 
local density with respect to Q to define a new probability P e on (ft, T), the 
physical probability, by 



P s (du) =\\a t (uj)\\ 1 Q(dL0) 

Ft 



P e (du;) 

or 



T t ' Q(dw) 



HkHlli- (25) 

Ft 



By taking a = 11 in (|20(l and by using the new physical probability we can 
write 

(l,g t (k)[ e ])=E Pe [<Z> t (k)}. (26) 

This equation shows that the Fourier transform of all the probabilities involved 
in the continual measurement is given by the characteristic functional of the 
process Y(t) under the probability P e . It is this fact which substantiates the 
interpretation of P g as the physical probability and of Y(t) as the output 
process. 

It is possible to prove that under the physical probability P e 

W(t) = W(t)-[ m(s)ds (27) 
Jo 







is a standard Wiener process and N(dz x dt) is a point process of stochastic 
intensity T t {z) p{dz)dt; we set 

N(dz x dt) = N(dz x dt) - Xt(z)fJ,(dz)dt . (28) 

The typical properties of the trajectories of the output signal can be visualized 
in a particularly simple manner when L ip2(z)zp,(dz) < +00; in this case we 
can write 

Y(t) = Y chv (t) + rW{t) + [ zN(dz x ds) (29) 

where J R X |- f , zN(dz x ds) is the jump part, with jumps of amplitude z and 

intensity T s (z)fi(dz)ds, rW(t) is a continuous part proportional to a Wiener 
process and 

Y chv (t)=t(c- J tp 2 {z)z[i{dz)^ + m{s)ds (30) 

is a continuous part with bounded variation. 

By rewriting Eq. i|20|) with the new probability, we have 

(a, &(*)[*?]) =Ep e [^ t (k)(a, Qt )}. (31) 

Because Q is the Fourier transform of all the finite-dimensional distributions 
and these distributions determine the whole i-process, this last equation is 
equivalent to: Va € C(H), V* > 0, V£ e B§, 

(a,Af t (E){g})= f (a, Pt (uj))P e {du>) . (32) 

This equation shows that p t is the state conditioned on the trajectory of the 
output observed up to time t and pt has indeed the meaning of a posteriori 
state at time t: the state we must attribute to the system under a selective 
measurement up to t. By taking k — into Eq. I|31|l or E = y into Eq. I|32|) . 
we get 

(a,77 t )=Ep e [( a ,p t )], (33) 

i.e. the a posteriori states pt(ui) with the physical probability P g (duj) realize 
a demixture of the a priori state 774 . Finally, by differentiating the definition 
(|24|l of the a posteriori states, we get the SDE 

(a, p t ) = (a, 0) + / (a, i?p s + p s R* - m(s)p s ) dW(s) 
Jo 

+ [ (a,](p s ;z)-p s )N(dzxds)+ I (a, C[p s }) ds , (34) 

JR,x(0,t] JO 

j(r;z) = (Tr{ t 7[r](z)})- 1 J[r](z) , r G S(7i) ; (35) 
Eq. I|34|) holds under the physical probability P e . 
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3 Entropies and information 



3.1 Quantum and classical entropies 



In quantum measurement theory both quantum states and classical probabil- 
ities are involved and, so, quantum and classical entropies are relevant. 

For x, y € T(7i), x > 0, y > 0, we introduce the functionals, with values 
in [0,+oolfiSl 



S q {x) = — Tr{xlnx} , S q (x\y) = Trjxlnx — xhn.y} : 



(36) 



if x, y £ S(7i), S q (x) is the von Neumann entropy and S q (x\y) is the quantum 
relative entropy. The von Neumann entropy can be infinite only if the Hilbert 
space is infinite dimensional and it is zero only on the pure states, while the 
quantum relative entropy can be infinite even when the Hilbert space is finite 
dimensional and it is zero only if the two states are equal. 

A first quantum entropy of interest is the a priori entropy S q (r)t), which 
at time zero reduces to the entropy of the initial state Sqfrfa) = S q (g). 

On the other hand, a classical entropy is the relative entropy (or Kullback- 
Leibler informational divergence) of the physical probability P g with respect 
to the reference probability measure Q: 



I t (P e \Q)=E Ps 



In 



Q(diu) 



r, 



= E Q [||a t || 1 ln|M| 1 ], 



(37) 



Let us note that h{P e \Q) > 0, I Q {P e \Q) = and that I t (P e \Q) is non de- 
creasing, as one sees by computing its time derivative: 



dt 



I t (P e \Q)=E Pe 



m{tf 



(l-l t (z)+l t (z)lnl t {z))n{dz) 



> . (38) 



If we consider two different initial states g a and p, with supp p a C supp p, 
we can introduce the quantum relative entropy S q (j]f\rjt) and the classical 
P g a\P g -relative entropy It{P e <^\P e ), 



It(P e 



\P e ) = Ep e , 



In ^ 



(dto) 



P e {du) 



= Er- 



in - 



o-t 



(39) 



Here and in the following P e a , er", pf ; 77" , m a (t), Tf{z) are defined by starting 
from g a as P e , at, pt, f}t, rnit), 1±{z) are defined by starting from g. 

Let us stress the different behaviour in time of the two relative entropies; 
this discussion will be relevant later on. The quantum one starts from S q (g a \g) 
at time zero and it is non increasing 

S q (v?h) = S q (U(t - s) [ V f] \U(t - s) [ Vs ]) < S q , t > s ; (40) 

this statement follows from the Uhlmann monotonicity theorem (ref.U*^Theor. 
5.3). The classical relative entropy starts from zero at time zero and it is non 
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decreasing, as one sees by computing its time derivative 



dt 



I t (P ga \P e )=E Ps . 



1 



(m a {t)-m{t)) 2 
l?(z) , 2?(*) ln Xf(z) 



l t {z)p(dz) 



>0. (41) 



X t (z) X t {z) X t (z) 

However, both relative entropies have the same bounds: 

< SMrjt) < S^g a \g) , < I t (P«\P e ) < S q (g a \g) . (42) 

The first statement is clear [see Eq. l|4(Jll ]. The second one too is a consequence 
of the Uhlmann monotonicity theorem, as can be seen by considering the 
"observation channel" A : C(H) -> L°°(tt, T u Q) with predual A* : g -> P e e 
L 1 (Q,,T t ,Q) (in ref. ^1 see p. 138, Theor. 5.3 and the discussions at pgs. 9 
and 151). 



3.2 Entropies and purity of the states 



When one is studying the properties of an instrument, a relevant question is 
whether the a posteriori states a re p ure or not and, if not pure, how to measure 
their "degree of mixing" . Ozawa^ called quasi- complete an instrument which 
sends every initial pure state into pure a posteriori states. A first measure of 
purity of the a posteriori states is the a posteriori entropy Ep g [S q (pt)] , which 
takes the initial value Ep g [S'q(po)] = S q (g). A related quantity, simpler to 
study, is the a posteriori purity (or linear entropy) 



p(t) = E Pg [Tr{p t (11 - pt)}] , p(0) =Tt{q(1- g)} 



(43) 



The a posteriori entropy and purity vanish if and only if the a posteriori states 
are almost surely pure and one hasp(t) <E Pg [S q ( Pt )]. 

By the rules of stochastic calculus (Table ^) we get the time derivative of 
the purity 

: p(t)= Pl (t)-p2(t)-Mt), (44) 



dt 

OO 

p 1 (t)=2^ 



P2{t)=E Pi 



Tr 



{p\ /2 {R 



Tr \j> t L*L jPt - p\ l2 L*p t Ljp\ 12 ^ 
R* - m{t)) Pt (R + R* - m(t)) p] /2 } 



(45) 



>0, (46) 



E Pe [Tr{l t {z)){p t -zf - 2J[p?]{z)+l t {z)p?}} p(dz) 



E f 



I t {z)- l Tr{(pt /2 Z{z)pt' 2 - Uz)Pt 



+ J[ Pt ]{zf-[pl ,2 2{z)pl /2 ) }]p(dz). 



(47) 
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Then, one can check the following points. 

(a) If pt is almost surely a pure state, then one has pi(t) > 0, p2(t) = 0, 
p 3 (t) = - j Rt E Pe [Tv{){p t -z)-)( Pt -zf}l t {z)\p(Az) <0. 

(b) The a posteriori states are almost surely pure for all pure initial states (i.e. 
the measurement is quasi complete) if and only if the following conditions 
hold: 

CI. C [-]=-i[H,-}; 

C2. j(r; z) is a pure state (/z-almost everywhere) for all pure states r or, 
equivalently, in JTUJ) ( Jh)(z,n) = ( Jh)(z), V7i G H. 

(c) Under the same conditions one has pi(t) = 0, p^{t) > for any initial 
state; as pi (t) > always, the purity decreases monotonically. 

The properties of the purity have also been use to find sufficient con- 
ditions (among which there is the quasi-completeness property) so that the 
long time limit of the a posteriori purity will vanish for every initial state; note 
that in a finite dimensional Hilbert space this is equivalent to the vanishing 
of the limit of the a posteriori entropy. 

Differentiating the a posteriori entropy demands long computations in- 
volving an integral representation of the logarithm (ref. LL^I p. 51) and the 
rules of stochastic calculus. We get 

1 E Pg [S q (p t )] = Ep^DM - DM - DM , (48) 
where, Vr E S(H), 

D 1 (t) = J2 Tl '{ ( L J L i T - L i TL *i) lnT ) > ( 49 ) 

3 

D 2 (r) = I d u Tr | ^-^ (R + R* - Tr { (R + R*) r}) — 

x (R + R* - Tr {(R + R*) r}) + - T [r, R] R* (50) 

(U + T) z U + T 



R 



D 



s(r) = y ^dz)(Tr{-J[rlnT](z)}-Tr{J[T}(z)}S q {](T-,z))). (51) 

From the time derivative of the a posteriori entropy we have the following 
results. 

(i) When t is a pure state, L»i(r) = if £V Tr {tL* (1 - r) Lj} = and 
Di(t) = +00 otherwise. 
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(ii) D2(t) > for any state r. When r is a pure state D2(t) = 0. 

(iii) Under condition C2 one has D^(t) > for any state r. 

(iv) When r is a pure state, D%{t) < in general and D%(t) = if condition 
C2 holds. 

Statements (i) and (iv) are easy to verify, while the proof of (iii) requires 
arguments introduced in Section 13.31 and will be given there. In order to 
study D2(t) we need the spectral decomposition of r: r = J^k^kPk, with 
k 7^ r => Afc 7^ X r ; by inserting this decomposition into Eq. ffiljl we get 

D 2 (r) = i^A fe Tr{[P fc (i 1 ' + i?*-Tr{(i? + i?*)r})P fc ] 2 } 
fc 

+ \T, Tl -^ R + R *^( R + R *) P ^T lh \- ln 1T' ( 52 ) 
which implies statement (ii). 

5.5 Mutual entropies and amount of information 

A basic concept in classical information theory is the mutual entropy (informa- 
tion). For two nonindependent random variables it is the relative entropy of 
their joint probability distribution with respect to the product of the marginal 
distributions and it is a measure of how much information the two random 
variables have in common. The idea of mutual entropy can be introduced also 
in a quantum context, when tensor product structures are involved. Ohya used 
the quantum mutual entropy in order to describe the amount of information 
correctly transmitted through a quantum channel A* from an input state g 
to the output state A* g. The starting point is the definition of a "compound 
state" which describes the correlation of g and A*g; it depends on how one 
decomposes the input state g in elementary events (orthogonal pure states). 
The mutual entropy of the state g and the channel A* is then defined as the 
supremum over all such decompositions of the relative entro py o f the com- 
pound state with respect to the product state g ® A*g (ref. pp. 33-34, 
139). 

We want to generalize these ideas to our context, where we have not only 
a quantum channel U(t), but also a classical output with probability law P e \ 
let us note that at contains the a posteriori states and the probability law 
and that it can be identified with a state on £(7i) L°°(f2, Tt, Q). Firstly, 
we define a compound state E t describing the correlation between the initial 
state g and the nnap state at- Let g — ^ Q w a g a be a decomposition of the 
initial state into orthogonal pure states (an extremal Shatten decomposition); 
if g has degenerate eigenvalues, this decomposition is not unique. With the 
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notations of Section 13.11 we have 



Vt = ^ W a (T? , 
a 

a 

The compound state Et will be a state on the von Neumann algebra 21 = 
C(H) ® C(H) O L°°(Q., T t , Q) = Mi®M 2 ® M 3 ; a normal state E on 21 is 
represented by a non negative random trace-class operator E on W ® H such 
that J n TrH®w{E(a;)}Q(da;) = 1: E(4) = /„ Tr H ®« |e»A(u;)} Q(du), 
A E 21. The relative entropy of the state E with respect to another state II 
with representative II is given by 

S(E|II) = J Tr W0 „ {E(w) (lnE» - lnfi(w)) } Q(dw) ; (54) 

this formula is consistent with the genera l Ar aki-Uhlmann definition of relative 
entropy in a von Neumann algebra (ref. Chapt. 5). 

We introduce the compound state E* on 21 by giving its representative 
E a w «? a ® (T ™ an d we consider the different possible product states which 
can be constructed with its marginal: lit = Etj^ ® ^*lx 2 ® w ^ 
representative \\<Jt\\ l Q® r)t, Hi = T, t \ Mi ® E t | M ^ rsMs with representative 
g®a tl Ilf = E 4 | M2 ® E t | Mi(8Al3 with representative £ a w Q Herf^ <? Q ® ryt, 

a<i®a<2 ® ^'Ijvia w ^ re P resen tative ||cr f 1^ ^ Q w Q £> Q ® 77". The 
different mutual entropies, i.e. the relative entropies of E t with respect to 
the different product states, are the object of interest. We can call 5(E t |II() 
the mutual input/ output entropy] this is a new informational quantity, which 
could be extended also to generic mea sure ments represented by instruments. 
First of all, from Corollary 5.20 of ref. El we obtain the chain rule 

s(E 4 |n t ) = s(E t |nj) + s(nj|n t ), i = 1,2,3. (55) 

Then, with some computations, we obtain the following relations: 

S(U}\U t ) = E Pe [S q ( Pt \vt)} = S q ( Vt ) - E Pg [S q ( Pt )} , (56) 

s(n?|n t ) = w « M^V = E w ° It( ^ p e a \Q) ~ WIQ) > ( 57 ) 

a a 

s(u?|n t ) = $> Q s Mh) = sm - E w « *W) ; ( 58 ) 

a a 



5> Q ^( w )P ea (da,) 



»7i 



Pt(w)P e (dw) 



(53) 
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s(x t \nl) = s(n 2 t \u t ) + 5>« Ep eQ [SM Pt )] 

(59) 

= 5(n?|n t ) + E Pe [s q ( Pt )] - $> a E ^ tW)] , 

a 

S(E*|II?) = $> a E PeQ [5 q (p?|»ft)] = S q ( Vt ) - £> Q E ^ tW)] » (60) 
s(s t |n?) = s(n?|n t ) + 5> Q E PeQ [5 q (p t Q |77r)] 

a 

= S(n?|n t ) + 2 «; Q S^fa?) - J] Wq Ep eQ [5 q (pf )] ; 



(61) 



S(s t |n t ) = s(n?|n t ) + s q fo) -$> a E ^ ■ (62) 



The initial values are 

s(£ |n ) = S(E Q |nJ) = 5(E |ng) = s(ng|n ) = s q ( g ) , 
s(£ |ng) = 5(nJ|n ) = s(n 2 \n ) = o . 



(63) 



The quantity S^n^nt) = Ep e [^(ptl??*)] is the a posteriori relative en- 
tropy^r^ because Eq. can be interpreted by saying that {P e (du), pt{to)} 
is a demixture of the a priori state rj t , such a relative entropy is a measure of 
how much such a demixture is fine. Let us observe that, for s < t, 

Ep e [S q (p*M] = Ep, [S q (pt|tt(t - s)[p s ])] + E Pe [S q (U(t - s)[ Ps }\vt)} ■ (64) 

It follows that the variation in time of the a posteriori entropy is the sum of 
two competing contributions of opposite sign: 

AE Pe [SMvt)] = Ep, [S q ( Pt+At \U(At)[ Pt })} 

+ {E Pe [S q (U(At)[p t ]\U(At)[ Vt ])}-E Pe [SMm)]} . (65) 

The first term is clearly positive and represents an information gain due to 
the process of demixture induced by the measurement. The second term is 
negative, once again as a consequence of the Uhlmann monotonicity theorem, 
and represents an information loss due to the partial lack of memory of the 
initial state induced by the dissipative part of the dynamics. 

The quantity 5(Ilf|II t ) = ^ a w a It{Pg a \P e ) has been introduced by 
Ozawa^ for a generic instrument under the name of classical amount of 
information. By the discussion in Section 13. II eqs. (|41J) and Ij42(l . one obtains 
that this quantity is non decreasing and bounded: 

< S(D?|n t ) =J2 W <* It(P e «\P e ) < X>«Sq((? a |e) = S q (g). (66) 
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The supremum over all extremal Shatten decompositions of 5(II(|II t ) = 
Yl a Wa SqiVt'lVt) is Ohya's "mutual entropy of the input state g and the chan- 
nel U(t)"; by g3 S(I$\n t ) is non increasing and by Theor. 1.19 of ref.EOit 
is bounded by 

< S(n?|n t ) = w « S M\Vt) < min {S^g), S q ( Vt )} . (67) 

a 

For general instruments OzawE^I introduced an entropy defect, which 
he called the amount of information] it measures how much the a posteriori 
states are purer than the initial state (or less pure, when thi s qu antity is 
negative). In the case of continual measurements it is defined by^ 

It(g) = S q (g)-Ep s [S q (p t )]. (68) 

If an equilibrium state exists, ?y cq € and £[^ cq ] = 0, by (|56|l we have 

Sq(Veq) > hiVeq) = [^(Ptl^eq)] > 0. For a quasi-complete continual 
measurement one has 

S q (g)>It(g)>S(TL 2 t \Tl t )>0, I t (g)>I s (g), t>s. (69) 

The first statement was proved by OzawJE for a generic quasi-complete in- 
strument, w hile the second one follows from the first one by using conditional 
expectations.^ We have I t {g) - I s {g) = E Pe [S q {p s ) - E Pe [S q {p t )\T s ]]; but 
Sq(Ps)~ Ep p [S'q(p t )|j?- S ] is the amount of information at time t when the initial 
time is s and the initial state is p s and, so, it is non-negative for a quasi- 
complete measurement. From the monotonicity of It(g) one obtains that the 
time derivative of Kp g [Sq(pt)\ is negative and this holds in particular at time 
zero for any choice of the initial state and also for R = 0. This proves the 
statement (iii) of Section l3~2l 
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